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Vortex is a topological defect with a quantized winding number of the phase in superfluids and 
superconductors. Here, we investigate the crystallized (triangular, square, honeycomb) and amorphous 
vortices in rotating atomic-molecular Bose-Einstein condensates (BECs) by using the damped projected 
Gross-Pitaevskii equation. The amorphous vortices are the result of the considerable deviation induced by 
the interaction of atomic-molecular vortices. By changing the atom-molecule interaction from attractive to 
repulsive, the configuration of vortices can change from an overlapped atomic-molecular vortices to 
carbon-dioxide-type ones, then to atomic vortices with interstitial molecular vortices, and finally into 
independent separated ones. The Raman detuning can tune the ratio of the atomic vortex to the molecular 
vortex. We provide a phase diagram of vortices in rotating atomic-molecular BECs as a function of Raman 
detuning and the strength of atom-molecule interaction. 



The realization of Bose-Einstein condensate (BEC) in dUute atomic gas is one of the greatest achievements for 
observing the intriguing quantum phenomena on the macroscopic scale. For example, this system is very 
suitable for observing the quantized vortex', and the crystallized quantized vortex lattice'^ ''. Furthermore, it is 
found that vortex lattices in rotating single atomic BEC with dipole interaction can display the triangular, square, 
"stripe", and "bubble" phases'*. In two-component atomic BEC, the vortex states of square, triangular, double- 
core and serpentine lattices are showed according to the intercomponent coupling constant and the geometry of 
trap^. Considered two components with unequal atomic masses and attractive intercomponent interaction, the 
exotic lattices such as two superposed triangular, square lattices and two crossing square lattices tilted by n/4 are 
indicated*. Generally speaking, the crystallization of vortices into regular structures is common in the single BEC 
and the miscible multicomponent BECs under a normal harmonic trap. Vortices in atomic BECs have attracted 
much attentions'"". However, it is not very clear the crystallization of vortices in atomic-molecular BECs'^"^^. 

The molecular BEC can be created by the magnetoassociation (Feshbach resonance) of cold atoms to mole- 
cules^", and by the Raman photoassociation of atoms in a condensate''''^'*. The atomic-molecular BEC provides a 
new platform for exploring novel vortex phenomena. It is shown recently that the coherent coupling can render a 
pairing of atomic and molecular vortices into a composite structure that resembles a carbon dioxide molecule". 
Considering both attractive and repulsive atom-molecule interaction. Woo et al. have explored the structural 
phase transition of atomic-molecular vortex lattices by increasing the rotating frequency. They observed the 
Archimedean lattice of vortex with the repulsive atom-molecule interaction. In fact, atom-molecule interaction 
can be either attractive or repulsive with large amplitude by using the Feshbach resonance™"''. In addition, we 
know that the population of atom and molecule in atomic-molecular BECs can be tuned by the Raman photo- 
association^'-^'". Then, we may wonder whether the combination control of Raman detuning and atom-mole- 
cule interaction may induce nontrivial vortex states and novel vortex phenomena. This seems not be well 
explored, especially in the grand canonical ensemble"" '". Furthermore, similarly to the normal system of two- 
component BECs', a phase diagram of vortices in rotating atomic-molecular BECs is required to provide a full 
realization of the nontrivial vortex phenomenon. 

In this report, we study the crystallized and amorphous vortices in rotating atomic-molecular BECs'"^". 
Amorphous vortices are the result of the considerable deviation induced by the interaction of atomic-molecular 
vortices. The phase diagram indicates that atom-molecule interaction can control the atomic-molecular vortices 
to suffer a dramatic dissociation transition from an overlapped atomic-molecular vortices with interlaced 
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molecular vortices to the carbon-dioxide-type atomic-molecular 
vortices, then to the atomic vortices with interstitial molecular vor- 
tices, and finally to the completely separated atomic-molecular vor- 
tices. This result is in accordance with the predicted dissociation of 
the composite vortex lattice in the flux-flow of two-band supercon- 
ductors''-". The Raman detuning adjusts the population of atomic- 
molecular BECs and the corresponding vortices. This leads to the 
imbalance transition among vortex states. This study shows a full 
picture about the vortex state in rotating atomic-molecular BECs. 

Results 

The coupled Gross-Pitaevskii equations for characterizing atomic- 
molecular Bose-Einstein condensates. We ignore the molecular 
spontaneous emission and the light shift effect^**"''"'''. According to 
the mean-field theory, the coupled equations of atomic-molecular 
g£(-.i733,4o written as 
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where 4'y(/ = a, m) denotes the macroscopic wave function of 
atomic condensate and molecular condensate respectively, the 

coupling constants are, ga= —r. — > Sm= ^r. and = 

-, also M„ (M„) is the mass of atom (molecule), 

M„Ma/{M„+Ma) 

CO is the trapped frequency, Q. is the rotation frequency. 



Lz[Lz = — ih(xdy—ydxY^ is the z component of the orbital angular 
momentum. The parameter x describes the conversions of atoms into 
molecules due to stimulated Raman transitions, e is a parameter to 
characterize Raman detuning for a two photon resonance^''^**"'' 

In real experiment, it is observed that the coherent free-bound 
stimulated Raman transition can cause atomic BEC of "'Rb to gen- 
erate a molecular BEC of "^Rb^^. In numerical simulations, we use the 
parameters of atomic-molecular BECs of "^Rb system with M,^ = 
2Ma = 2m{m= 144.42 X 10"" Kg),g„, = Ig^ (a^ = Wl.Sag, where 

is the Bohr radius), x = 2X 10"', and the trapped frequency oj = 
100 X 2n. Note that if the change in energy in converting two atoms 
into one molecule (A(7 = 2Uj-a — Uj^^^, not including internal 
energy, approaches zero, we can obtain the value 2ga = gm- The unit 
of length, time, and energy correspond to \/h/{muj) (=1.07 fim), 
CO"' (=1.6 X 10"' s), and fico, respectively. 

Crystallized and amorphous vortices in rotating atomic-molecular 
Bose-Einstein condensates. With rotation frequency Q = 0.8co, we 
study the influence of atom-molecule interaction on the formation of 
vortices. Figure 1 displays the densities and phases obtained under the 
equilibrium state with different atom- molecule interactions. The first 
and the second columns are the densities of the atomic BEC and the 
molecular BEC, respectively. The third column is the total density. 
The fourth and the fifth column are the corresponding phases of 
atomic and molecular BECs, respectively. The vortices can be 
identified in the phase image of BECs. 

The composite of atomic and molecular vortices locates at the trap 
center to lower the system's energy. For the case of attractive atom- 
molecule interaction {gam — ^0.87^^). vortices form a square lattice 
[see Fig. 1(a)]. Interestingly, we can observe that the size of the 
molecular vortices can be divided into two types: one is big, and 
the other is small. Each atomic vortex has approximately the same 
size. Figure 2(a) further plots the vortices, where the atomic vortices 
overlap with a molecular one. The overlapping of atomic and 
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Figure 1 | The densities and phases of atomic-molecular BECs of "'Rb when the system reaches the equilibrium state. The rotation frequency is = 
0.8co. The strength of atom-atom interaction is g„ with the scattering length = 101. Sa^. The strength of molecule-molecule interaction is twice as 
much as that of atom-atom interaction. The strength of atom-molecule interaction and Raman detuning is set as (a) g„,„ = ~0.87g„, £ = 14fico, 
(b) gam = 0, £ = 14?!co, (c) g„,„ = 0.87g„, £ = 14?!fo and (d) g„,„ = Ig^, £ = 7?Jco. Note that the fourth and fifth columns are the phases of atomic and 
molecular BECs, respectively. The unit of length is 1.07 ^m. 
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Figure 2 | Vortex configurations and vortex position, (a) The scheme of 
composite vortices in Fig. 1(a). The size of the right molecular vortex 
which overlaps with an atomic vortex is bigger than the left one. (b) The 
scheme of carbon-dioxide-type vortex structure in Fig. 1 (b). The size of the 
atomic vortex is bigger than that of the molecular vortex. The red, black 
and blue indicate the densities of atomic BEC, molecular BEC and the sum, 
respectively, (c), (d), (e) and (f) showthe position of vortices in Figs. 1(a)- 
1(d), respectively. The circle ( O ) and asterisk (*) are the position of 
vortices formed by atomic BEC and molecular BEC, respectively. In (c), the 
red lines indicate that vortices can array in the square lattice. In (d), the 
blue Knes show atomic vortices form the triangular lattice. While, 
the deviation of molecular vortices from the red lines indicates they form 
the amorphous state. In (e), atomic vortices form the triangular lattice and 
molecular vortices form the honeycomb lattices. Similarly, molecular 
vortices display the triangular lattice in (f). The unit of length is 1.07 /im. 

molecular vortices causes the size of molecular vortices to become 
big. Thus, we obtain different size of molecular vortices in the same 
experiment. 

It is easy to understand the size enlargement of molecular vortices 
which are overlapping with atomic ones. The size of vortex reflects 

the healing length = h[2mgn) ^ where n is the uniform density 

in a nonrotating cloud""] of the BEC because within this distance, the 
order parameter 'heals' from zero up to its bulk value. The attractive 
interspecies interaction implies that the densities of the two BECs 
would have a similar trend to decrease and increase. It also causes 
some molecular vortices to overlap with atomic ones. In addition, 
the density of atomic BEC forms local nonzero minima at the region 
of the left molecular vortex [see Fig. 2(a)]. Here, the size of atomic 
vortices is obvious bigger than that of molecular vortices. Therefore, 
the local density of molecular vortices follows that of atomic vortices 



and the size becomes big when molecular vortices overlap with 
atomic vortices. 

When g^^ = 0, atomic vortex lattices are triangular and the 
molecular vortices are amorphous state [see Fig. 1(b) and 
Fig. 2(d)]. Meanwhile, the total density (the third column) indicates 
that the molecular vortices and the atomic vortices form some struc- 
ture like the carbon dioxide, which is also observed by a different 
method". Figure 2(b) shows an enlarged configuration of the carbon 
dioxide vortices. Here, the size of atomic vortices is much larger than 
that of the molecular one. With repulsive interaction {gam = 0.87ga), 
vortex lattices are approximately hexagonal with a little deviation 
[see Fig. 1(c)]. Increasing atom-molecule interaction up to gam = 
2ga [see Fig. 1(d)], atomic-molecular BECs separate into two parts, 
molecular BEC locating at the center and atomic BEC rounding it. 
The results are understandable, since the mass of a molecule is twice 
as that of atom, molecular BEC tends to locate at the center. This is 
much different from that of the normal two-component BECs, where 
the same mass and intraspecies interactions are considered^. 

Figures 2(c)-2(f) further illuminate the position of vortices. Note 
that we do not point out the vortices where the densities of BECs are 
very low. We approximately view the vortex lattice as triangular, 
square, etc, although some vortices may deviate from the regular 
lattice slightly. The distance of adjacent lattice sites of atomic vortices 
is \/2 times of that of molecular vortices [see Fig. 2(c)]. We have 
plotted a green circle to differentiate these vortices as two parts. The 
atomic vortices construct an approximately quadrangle lattice, espe- 
cially near the center region, the atomic vortices overlap with a 
molecular one locating among four adjacent molecular vortices. 
Thus, vortex position indicates that vortices density of atomic BEC 
is half of that of molecular vortices. The atomic vortices expand over 
to the outskirts of the lattice where no overlapped molecular vortices 
appear [see Fig. 2(c)]. 

Figure 2(d) indicates that the carbon dioxide structure is not fixed 
in the same orientation. Similarly to Fig. 2(c), the carbon dioxide 
structure only exists at the center. However, the deviation of molecu- 
lar vortices from the red lines d, e, and f is so large that we have to 
view the molecular vortices as an amorphous state. Vortex position 
in Fig. 2(e) shows that atomic vortices form the triangle lattice. AU 
molecular vortices are distributed among atomic vortices, forming 
the hexagonal lattices without overlapping. Certainly, atomic vor- 
tices and molecular vortices are separated in Fig. 2(f) according to the 
immiscibility of atomic-molecular BECs with strong We can 
conclude that the strength of atom-molecule interaction can adjust 
the composite degrees of vortices, and cause the overlapping com- 
posite, carbon-dioxide-type composite, interstitial composite and 
separation. 

Furthermore, we find that the lattice configuration of vortices is 
very complex when atomic vortices and interstitial molecular vor- 
tices coexist. In Fig. 1(c), atomic vortices form the triangular lattice 
and interstitial molecular vortices display the honeycomb lattice. We 
further plot the densities of atomic BEC and molecular BEC at vari- 
ous cases in Fig. 3. When the number of atoms is much more than 
that of molecules, vortices in atomic BEC tend to form the triangular 
lattice, and vice versa. The lattice configurations are triangular in 
Figs. 3(a2), (b2), (el) and (fl). Atomic vortices display square lattice 
in Figs. 3(al)-3(cl). In all other subplots, the lattices are irregular 
and can be viewed as the amorphous state. For example, the number 
of adjacent molecular vortices which form bubbles'* around some 
atomic vortices is not six but five in Figs. 3(d2)-(f2). In fact, the 
regular structures imply that both long-range order and short-range 
order should be remained. Thus, the observed random configuration 
is really amorphous. 

The phase diagram of rotating atomic-molecular Bose-Einstein 
condensates. To explore the phase diagram of atomic-molecular 
vortices, we firstly show the modulation effect of Raman detuning 
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Figure 3 | The effect of Raman detuning on the lattice of atomic vortices with interstitial molecular vortices at the equilibrium state. Here the strength 
of interactions are g,„ = 2g„ and g„,„ = O.SJg^. The rotation frequency is = 0.8co. The upper plots [(al)-(fl)] show the densities of atomic BEC 
and the lower plots [(a2)-(f2)] indicate the corresponding densities of molecular BEC. The value of Raman detuning varies, (a) 8 = —2%lo, (b) 8 = Ofico, 
(c) 8 = 2fioj, (d) 8 = 4fico, (e) 8 = 7fico, and (f) e = lOfico. (al), (bl) and (cl) are the square lattice. (a2), (b2), (el) and (fl) are the triangular lattice. Other 
plots show the amorphous state. The unit of length is 1.07 /im. 



for the number of vortices in rotating atomic-molecular BECs. 
Figures 4(a)-(d) show the relationship between vortices number 
and Raman detuning. Generally speaking, the number of mole- 
cular vortices decreases monotonously as Raman detuning 
increases. As we can see ior g^m = ^0.87^^, 0, 0.87^^ and Ig^, the 
slope of the number of molecular vortices is —2.7, —3.4, —4.2 and 

— 7.8, respectively. Increasing of the strength of atom- molecule 
interaction, the faster the number of molecular vortices decreases 
as Raman detuning increasing. The number of atomic vortices 
approaches to 40 as the Raman detuning increasing. Thus, the 
ratio of atomic vortices and molecular vortices is not fixed as the 
Raman detuning changes in atomic-molecular BECs. Furthermore, 
we calculate the number of composite vortices, i.e., the atom-vortex 
number and the molecule-vortex number in the green circles 
in Figs. 2(c)-(e), and define the parameter P„ = 100C^/C^. Pa in 
Figs. 4(a), (b), and (c) are almost around the value of 50, i.e, 
C'a ■ C^ — l : 2. Thus, the composite vortices keep the ratio 1:2 
approximately. The deviation of Pa from dash black line with the 
value of 50 mainly comes from vortices at the boundary. Certainly, 
vortex number in pure atomic BEC is independent of both atom- 
molecule interaction and Raman detuning. 

Now, we further indicate the modulation effect of Raman detuning 
for particle numbers of atomic-molecular BEC of "^Rb [see Figs. 4(e)- 
(h)] . The particle numbers in equilibrium state depend on the system 
itself For attractive atom-molecule interaction = — 0.87^„, both 
of atom number and molecule number decrease when the Raman 
detuning increases. Meanwhile, atom number always is greater than 
molecule number [see Fig. 4(e)]. For the limit case oigam — 0, atom 
number keeps unchanged and only molecule number decreases as 
the Raman detuning increases [see Fig. 4(f)]. When the interaction is 
repulsive (gam > 0)> molecule number keeps decreasing but atom 
number increases [see Figs. 4(g) and (h)]. When the repulsive inter- 
action is up to gam = 2ga, the single molecular BEC or the single 
atomic BEC can be obtained by adjusting Raman detuning from 

— Ahco to lAhco. The particle numbers can characterize the possible 
regions for the existence of atomic-molecular vortices. 

Figure 5 plots the phase diagram of atomic-molecular BECs. The 
stable atomic-molecular BECs system exists only when atom-mole- 
cule interaction is larger than — y/gagm- When the Raman detuning 
is large enough, single atomic BEC occurs. Oppositely, if the Raman 
detuning is low enough, production changes into pure molecular 
BEC. Between these two regions, it is atomic-molecular BECs, where 



AMBEC(I) denotes the miscible mixture and AMBEC(II) stands for 
the phase separated mixture. Therefore, to explore atomic-molecular 
vortices, we mainly focus on AMBEC(I) region. 

According to above analysis about atomic-molecular vortices and 
the corresponding atomic-molecular BECs, we calculate lots of other 
results and finally give a vortex phase diagram to summarize the 
vortex structures in Fig. 5. In (1) region [ — \Jgagm <gam < 
~0-l&]. atomic-molecular vortices form the square lattice where 
the overlapped atomic-molecular vortices and the molecular vortices 
interlacedly exist. The carbon-dioxide-type atomic-molecular vor- 
tices occur in (2) region [-0.1^^ £ ga^ < 0.5^^]. Atomic vortices 
with interstitial molecular vortices emerge in region (3). In the 
AMBEC(II) region, atomic vortices and molecular vortices are sepa- 
rated. Certainly, in the region of atomic BEC (molecular BEC), 
atomic vortices (molecular vortices) favor to form the triangular 
lattice. The green region indicates that the created atomic and 
molecular vortices fully match with each other by roughly the ratio 
1 : 2. Above the green region, more atomic vortices occur. Below the 
green region, more molecular vortices appear. Table 1 shows a sum- 
mary of the details of various vortices in rotating atomic-molecular 
BECs. 

Interestingly, the vortex phase diagram indicates some exotic tran- 
sitions, (i) Imbalance transition: The increase of Raman detuning 
causes more atomic BEC. Thus, the pure molecular vortices change 
into carbon-dioxide-type atomic-molecular vortices (atom vortices 
with interstitial molecular vortices, and separated atomic-molecular 
vortices), and finally into single atomic vortices in region of 0 < gam 
< 0.5ga (O.Sga <gam < ^gagm, audgam > ^ gagm. respectively). In the 
region of - ^gagm <gam<- 0. l^a ( " 0. lg^„ <^a„, < 0), the inter- 
laced-overlapped atomic-molecular vortices (the carbon-dioxide- 
type atomic-molecular vortices) become into atomic vortices under 
a very high detuning parameter, (ii) Dissociation transition: By chan- 
ging the atom-molecule interaction from attractive to repulsive, the 
composite atomic-molecular vortices change from overlapped to 
carbon-dioxide-type and finally into the independent separated 
ones. 

Discussion 

In this report, we focus on the strength of atom-molecule interaction 
and the Raman detuning term. The form of HamUtonian in this 
paper is like that in the Ref 17. In fact, a real experiment would 
include lots of other factors such as the light shift effect^"'^' decay 
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Figure 4 | The number of vortices and particles, (a)-(d) show the number of atomic vortices C„ and molecular vortices C,„ in atomic-molecular BECs of 
"'Rb with the detuning parameter £ when the system reaches the equilibrium state, (a) g„„, = — 0.87g„, (b) g„,„ = 0, (c) g„„, = 0.87g„and (d) g„,„ = 2g„. (e)- 
(h) indicate the corresponding particle number of atomic-molecular BECs of "^Rb, respectively. The rotation frequency is Q = 0.8(u, the strength of 
molecule-molecule interactions are g,„ = 2g^ with the atom-atom scattering length = 101. Sa^, and the parameter / is fixed to be 2 X 10"'. The unit of 
detuning parameter is Ha>. 



due to spontaneous emission'". In Ref. 33, Gupta and Dastidar have 
considered a more complicated model when they study the dynamics 
of atomic and molecular BECs of 'Rb in a spherically symmetric trap 
coupled by stimulated Raman photoassociation process. In fact, the 
light shift effect almost has the same function as the Raman detuning 
term. Thus, it can be contributed to the Raman detuning term. This is 
the reason why we do not consider the light shift term in 
Hamiltonian like that in Ref 33, but follows the form in Ref 17. 

In real experiment, it is believed that the single molecular BEC 
would occur when the Raman detuning goes to zero^"". However, 
the measure of the remaining fraction of atom does not reach the 
minimum when Raman detuning is zero^**. With the adiabatic con- 
sideration, the dynamical study also agrees with this point"". In fact, 
they show the evolutionary process of creating a molecular BEC from 



a single atomic BEC. Thus, particle number of molecular BEC varies 
with time but not fixed. The resonance coupling would cause the 
atomic BEC to convert into a molecular one as much as possible, but 
the molecular BEC also wiU convert into the atomic one. Therefore, 
the results in Ref 28, 33 only shows a temporary conversion of atoms 
into molecules. In fact, when we use single atomic BEC as the initial 

condition and set — ^ — 0, the temporary conversion of atomic BEC 

into molecular BEC can be observed with current damped projected 
Gross-Pitaevskii equations. 

It is obvious that the Raman detuning term in the Hamiltonian 
behaves just like the chemical potential to control the system's 
energy. The external potential for atomic BEC is frxed to be V„{r) 
and molecular BEC experiences the trap potential V^{r) + s. Here, 
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Figure 5 | Phase diagram of rotating atomic-molecular BECs of "'Rb 
when the system reaches the equilibrium state. AMBEC(I) denotes the 
miscible mixture of atomic-molecular BECs, and AMBEC(II) is 
immiscible atomic-molecular BEC. Furthermore, based on the phase 
diagram of atomic-molecular BECs, we further plot the phase diagram of 
atomic-molecular vortices when the atomic-molecular BECs of "^Rb 
reaches the equilibrium state. Then, the region of AMBEC(I) is divided 
into three parts: (1), (2), and (3). The overlapped atomic-molecular 
vortices, carbon-dioxide-type atomic-molecular vortices and atomic 
vortices with the interstitial molecular vortices occur in region (1), region 
(2) and region (3), respectively. In the green region, atomic and molecular 
vortices match fully with the rough ratio 1 : 2. The parameters are CI = 
O.Sco, g„ = 2g^ (a^ = 101. Sci^), and x = 2 X 10"-\ The units of detuning 
parameter and g„,„ are fioj and respectively. 

our method initially derives from the finite-temperature considera- 
tion: the system is divided into the coherent region with the energies 
of the state below and the noncoherent region with the energies of 
the state above E^*^-'^-^. So, our method will behavior just likes to catch 
the particles with a shallow trap and exchange particles with an 
external thermal reservoir. But ultimately we remove the external 
thermal reservoir to get system to the ground state. Raman detuning 
changes the depth of shallow trap to — £. The molecular BEC 
will be converted by atoms until the system reaches the equilibrium 
state. Therefore, a maximum of creating molecular BEC does not 
occur at the equilibrium state when Raman detuning varies. Instead, 
molecule number decreases monotonously when Raman detuning 
increases. 

Why do atomic-molecular vortices display so rich lattice config- 
urations? In fact, atomic vortices and molecular vortices tend to be 
attractive in region (1) and (2). Otherwise, the overlapped atomic- 
molecular vortices and the carbon-dioxide-type ones can not occur. 



The attractive force makes atomic vortices and molecular vortices 
behave similarly. Thus, both atomic and molecular vortex lattices in 
region (1) are square. In region (2), atomic vortices display the tri- 
angular lattice. Molecular vortices seem to follow the triangular lat- 
tice but the interaction among vortices causes the considerable 
deviation. Obviously, the C02-type structures do not foUow the fixed 
direction, i.e., long-range order vanishes but there is still short-range 
order. Thus, we have to view molecular vortices as the amorphous 
state. In region (3), atomic vortices and molecular vortices can not 
form the carbon dioxide structure. Because the size of molecular 
vortices is smaller than that of atomic vortices, it tends to locate at 
the interval of the lattice of atomic vortices. When the number of one 
component is much more than that of the other, the vortices of this 
component dominate over the vortices of the other component. The 
former is easy to form the regular vortex lattice. The latter has to 
follow the interaction of the former and forms the vortex lattice. The 
amorphous state originates from the competition between atomic 
vortices and molecular vortices, especially when the number of atom 
and molecule has the considerable proportion [see Figs. 3(dl) and 
3(d2)]. In that case, short-range order is only partly kept and ulti- 
mately long-range order is destroyed. Certainly, this also causes the 
distribution of vortices in one component is relatively regular and 
that in the other component is amorphous. 

The structural phase transitions of vortex lattices are explored 
through tuning the atom-molecule coupling coefficient and the rota- 
tional frequency of the system". Certainly, the Archimedean lattice 
of vortices in Ref. 17 is one of the interstitial-composite-structures. 
Here, we show the crystallized and amorphous vortices by the com- 
bined control of Raman detuning and atom-molecule interaction. In 
fact, when we increase the value of x> the C02-type structure of 
vortices are easy to be created. Even the interstitial-composite struc- 
ture we now obtain in Fig. 3 would transfer into the C02-type struc- 
ture if X is big enough. We have also considered the effect of rotation 
frequency. With the attractive interaction of atom-molecule {gam = 
— 0.87^„), Figure 6 shows various rotation frequencies to produce the 
vortices. Figure 6(a) indicates that no vortex would occur with Q = 0. 
For Q = 0.2oj, only one molecular vortex is induced. In atomic BEC, 
the phase indicates no vortex is created although there is a local 
minimum of density near the center. For SI = 0.4oj, the phase indi- 
cates that there is an atomic vortex. In fact, we find the atomic vortex 
is overlapped with a molecular vortex. Undoubtedly, more and more 
vortices emerge when rotation frequency increases. When the rota- 
tion frequency is up to Q = O.Sco, we can obtain a regular square 
vortex lattice. Meanwhile, each atomic vortex is overlapped with a 
corresponding molecular vortex. Obviously, vortices and vortex lat- 
tice may not be induced with a slow rotation. This is the reason why 
we favor to investigate the vortices with a fast rotation in Figs. 1-4. 

We now show that ultracold Bose gases of "^'Rb atoms are a can- 
didate for observing the predicted atomic-molecular vortices. By 



Table 1 | A summary of the properties of vortices in the rotating atomic-molecular BECs of ^^Rb when the system reaches the equilibrium 
state. The atomic-molecular vortices are composite in the matching region [inside the green circle in Figs. 2(c)-(e)] 

Region Vortex state (in the Vortex lattice out of 
(in Fig. 5) matching region) Lattice of atomic vortex Lattice of molecular vortex the matching region 


(1) 


Overlapped atomic-molecular 


square 


square 


triangular 




vortices with interstitial 










molecular vortices 








(2) 


carbon-dioxide-type atomic- 


triangular 


amorphous 


triangular 




molecular vortices 








(3) 


atomic vortices with interstitial 


square/amorphous/triangular 


triangular/amorphous/honeycomb 
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Figure 6 | The densities and phases of the atomic-molecular BECs of "'Rb under various rotating frequencies when the system reaches the equUibrium 
state. The rotating frequencies are indicated at the title of the subplots, (al)-(el) are the densities of atomic BEC, (a2)-(e2) are the corresponding phases 
of atomic BEC, (a3)-(e3) are the densities of molecular BEC, and (a4)-(e4) are the corresponding phases of molecular BEC, respectively. The critical 
rotating frequencies for inducing molecular vortex and atomic vortex are about 0. Ico and 0.3co, respectively. The strength of atom-molecule interaction is 
gam = —0.87g„ with the atom-atom scattering length fl„ = 101.8%, molecule-molecule interactions is = 2g„, the parameter / is fixed to be 2 X 10"^ and 
Raman detuning is £ = Qhoj. The unit of length is 1.07 ^m. 



initially using a large atomic BEC of^'Rb (the atom number is up to 
3.6 X 10^ in Wynar's experiments^), the Raman photoassociation of 
atoms^^'S"''"'""'^ can produce the corresponding molecular BEC with 
partial of the atoms. By loading a pancakelike optical trap 

Vj=a,m{x,y,Z) = — , With trappmg frequencies 

ffl^Sxu' the 2D atomic-molecular BECs may be prepared. It is 
convenient to use the laser to rotate the atomic-molecular BECs 
and induce the atomic-molecular vortices. Meanwhile, the whole 
system should be further quenched to a lower temperature to 
approach the ground state by the evaporative cooling techniques. 
The resulting atomic-molecular vortices may be visualized by using 
the scanning probe imaging techniques. All the techniques are there- 
fore within the reach of current experiments. 

In summary, we have observed various new atomic-molecular 
vortices and the lattices controlled by atom-molecule interaction 
and Raman detuning. Including the regular vortex lattices, we have 
displayed amorphous vortex state where vortices do not arrange 
regularly but like amorphous materials. We have obtained the vortex 
phase diagram as function of Raman detuning and atom-molecule 
interaction in the equilibrium state. Vortex configuration in atomic- 
molecular BECs includes the overlapped atomic-molecular vortices, 
the carbon-dioxide-type vortices, the atomic vortices with interstitial 
molecular vortices, and the completely separated atomic-molecular 
vortices. The lattice configuration of vortex mainly depends on 
atom-molecule interaction. For example, the overlapped atomic- 
molecular vortices display the square lattice. When the carbon-diox- 
ide-type vortices occur, atomic vortices show the triangular lattice 
and molecular vortices show the amorphous state. Atomic vortices 
and interstitial molecular vortices can show several types of lattice, 
such as triangular, honeycomb, square and amorphous. And both 
atomic and molecular vortices show the triangular lattice in the 



incomposite region and in single BEC. Our results indicate that 
atom-molecule interaction can control the composite of atomic 
and molecular vortices, and can also cause novel dissociation trans- 
ition of vortex state. Furthermore, the Raman detuning can control 
the numbers of particles in atomic-molecular BECs and approxi- 
mately lead to the linear decrease of molecular vortices. This may 
induce the imbalance transition from atomic-molecular vortices to 
pure atomic (molecular) vortices. This study shows rich vortex states 
and exotic transitions in rotating atomic-molecular BECs. 

Methods 

We use the damped projected Gross-Pitaevskii equation (PGPE)'^ to obtain the 
ground state of atomic-molecular BEC. By neglecting the noise term according to the 
corresponding stochastic PGPE'''', the damped PGPE is described as 

d^j = vi^-'-Hj^jdt+ ^ ^n-H,)^idty (2) 

where, H/^y — iPi , T is the final temperature, kg is the Boltzmann constant, is 

the chemical potential, and yj is the growth rate for the jth component. The projection 
operator V is used to restrict the dynamics of atomic -molecular BEC in the coherent 

region. Meanwhile, we set the parameter =0.03. The initial state of each is 

generated by sampling the grand canonical ensemble for a free ideal Bose gas with the 
chemical potential o ~ o ~ 8^co. The final chemical potential of the non- 
condensate band are altered to the values — 2^f« ~ ISHco. 
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